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(57)Abstract: 

PROBLEM TO BE SOLVED: To model the shape of a 
body having a part which is hardly measured in three 
dimensions by synthesizing three-dimensional shape data 
with plural two-dimensional shape data of the body. 
SOLUTION: A generated shape model Uh for a head 
hair part and a shape model Uf for a customer obtained 
through three-dimensional measurement are positioned 
and arranged in a three-dimensional space and set 
operation for finding the sum of the both is performed to 
synthesizing one shape model UM. At this time, the 
shape model Uh for the head hair part is handled as an 
auxiliary model for restoring deficiencies of the 
measurement and when superposition is contradictory, 
data corrections are made while priority is given to the 
shape model Uf in principle. The shape model UM which 
is thus obtained is used to perform processing and then 
even if data of part of the head hair is not obtained by the 
three-dimensional measurement, a face model having the 
outline of the head hair correctly reproduced can be 
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1 .This document has been translated by computer. So the translation may not reflect the original 
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CLAIMS 



[Claim(s)] 

[Claim 1] The modeling system characterized by having a three-dimension measurement means 
to measure an objective three-dimension configuration and to output the 1st configuration data, a 
means to photo said body from a different location and to obtain two or more two-dimensional 
images, a means to generate the 2nd configuration data based on said two or more two- 
dimensional images, and a means to compound said 1st and 2nd configuration data. 
[Claim 2] Said three-dimension measurement means is a modeling system according to claim 1 
which projects a reference beam on a body, receives the reflected light, and measures a 
configuration based on the light-receiving output. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention is used for creation of the model of a body head, 
concerning the modeling system which generates the geometric model of the body which exists. 
[0002] 

[Description of the Prior Art] The non-contact type three-dimension metering device (range 
finder) of a portable mold is commercialized, and it is used for the visual recognition of the data 
input to CG system or a CAD system, a somatometry, and a robot etc. As the non-contact 
measurement approach, although slit light projection (optical cutting method) is common, 
otherwise, pattern light projection, the stereo ** method, the interference fringe method, etc. are 
learned. 

[0003] On the other hand, a kind of automatic vending machine which creates a user's 
photograph-of-his-face seal on that spot is collecting popularity. A user throws in the coin for a 
tariff, and he makes a favorite pose by Saki of a camera, looking at a monitor image. And if 
predetermined actuation is performed, the sheet with which a fixed number of seals were located 
in a line will be created, and it will be discharged by output port. 
[0004] 

[Problem(s) to be Solved by the Invention] According to the above-mentioned three-dimension 
metering device, the configuration of the various bodies which contain the body by handiness 
comparable as taking a photograph can be data-ized. Since it is a non-contact type, even if it is 
the case where the body is measured, a measurement candidate does not sense troublesomeness. 
[0005] However, in especially the optical three-dimension measurement that projects reference 
beams, such as slit light, the configuration of the hair part of the body may be correctly 
immeasurable. That is, with black hair, since the reflection factor of a reference beam is low, the 
light income of a range finder becomes inadequate and a measurement value tends to be missing. 
Moreover, the effect of a hair style is also large. For this reason, on the occasion of creation of 
the geometric model of a body head, there was a problem of a hair part not having been 
reproduced or becoming imperfect. 

[0006] This invention aims at three-dimension measurement realizing modeling of the 

configuration of a body with a difficult part. 

[0007] 

[Means for Solving the Problem] In this invention, the part of an objective specific color is 
modeled in simple using two or more two-dimensional photography information that whenever [ 
to a body / angle-of-coverage ] differ. For example, from each of two or more two-dimensional 
images which photoed the body from a mutually different location and were obtained, the field 
which fills the setups of color information is extracted and the geometric model of the part which 
fills the setups in a body is generated by calculating the coordinate in the virtual space of the 
location on the body corresponding to each profile of two or more extracted fields. Two or more 
two-dimensional images which photoed the body in more detail from the location where they 
differ mutually as a look crosses at one point in, and were obtained Image size is arranged so that 
an objective representative fraction may be in agreement, it arranges to a virtual space so that 
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each core may be in agreement and a mutual arrangement angular relation-ship may correspond 
to the relation of the sense of a look and a field angle, and the relative-position relation of the 
profile of the field which fills the setups of the color information extracted from the 2- 
dimensional each image is calculated. The core of an image is a pixel location corresponding to 
the look at the time of photography (light-receiving shaft). 

[0008] A geometric model with high fidelity is obtained by using together modeling based on the 
three-dimension measurement information in which modeling based on two-dimensional 
photography information and modeling highly precise than it are possible. 
[0009] The modeling system of invention of claim 1 has a three-dimension measurement means 
to measure an objective three-dimension configuration and to output the 1st configuration data, a 
means to photo said body from a different location and to obtain two or more two-dimensional 
images, a means to generate the 2nd configuration data based on said two or more two- 
dimensional images, and a means to compound said 1st and 2nd configuration data. The 
hardware containing the processor for a general purpose or image processings and suitable 
software can constitute a means to generate configuration data, and a means to compound. 
[0010] In the modeling system of invention of claim 2, said three-dimension measurement means 
projects a reference beam on a body, receives the reflected light, and measures a configuration 
based on the light-receiving output. 
[0011] 

[Embodiment of the Invention] Drawing 1 is the external view of the three-dimensional-model 
listing device 1 concerning this invention. The three-dimensional-model listing device 1 
measures a body configuration, has the function to process a material on that spot based on the 
measurement data, and is used as an automatic vending machine of the accessories article which 
modeled a user's face. The goods created are the stereos with which the model of the face (the 
hair is included) projected from the plate surface of a predetermined configuration (for example, 
square). It is also possible to add a specific boom-hoisting pattern to a plate surface (a part for a 
background). If the suitable metallic ornaments for such goods are attached, it will become 
accessories, such as a pendant, a broach, and a key holder. Metallic ornaments may be 
beforehand attached in a material. 

[0012] The floodlighting aperture 12 and the light-receiving apertures 14, 15 A, and 15B are 
formed in the front face of the almost life-size Johan section of a case 10 with the display 16 for 
a user to check a pause. Optical three-dimension measurement is performed using the 
floodlighting aperture 12 and the light-receiving aperture 14. The light-receiving aperture 14 is 
used also for the two-dimensional color photography of the direction of a transverse plane. The 
light-receiving apertures 15A and 15B are used for the two-dimensional color photography of the 
direction of slant peculiar to this invention. The bottom half section of a case 10 is jutted out 
over the front side rather than the Johan section, and the top face serves as a control panel 18. 
The output port 20 of goods is established in the front face of the bottom half section. 
[0013] Drawing 2 is the mimetic diagram of the busy condition of the three-dimensional-model 
listing device 1 . The blue background sheet 2 is arranged ahead of the three-dimensional -model 
listing device 1. A user 3 stands toward the three-dimensional-model listing device 1, using the 
background sheet 2 as the back, and throws in the coin for a tariff. If a user 3 performs start 
actuation after that, the three-dimensional-model listing device 1 will display the three- 
dimension geometric model (for example, surface model) which shows a measurement result 
while measuring the configuration of the body which exists within the limits of [ fixed ] a 
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transverse plane. And if a user 3 performs confirmation operation, the three-dimensional-model 
listing device 1 will start three-dimension processing according to a measurement result. Goods 
are completed by the time amount for about several minutes. A user 3 takes out goods from 
output port 20. 

[0014] Drawing 3 is the top view of a control panel 18. The input port 185 of a start button 181, 
a confirmation button 182, Cancel button 183, a joy stick 184, and a coin is established in the 
control panel 18. A start button 181 is a start actuation means, and a confirmation button 182 is a 
confirmation operation means. A joy stick 184 is used for modification directions of the 
composition of a model. In response to the Pan actuation leaned to right and left, the tilt 
actuation leaned up and down, and roll actuation of rotating a knob, rotation processing of a 
three-dimension geometric model is performed, and a processing result is displayed on serial. 
Moreover, Cancel button 183 is an actuation means for directing re-measurement, when the 
three-dimension geometric model as which the user 3 was displayed is not pleasing. However, 
the count of effective is set to Cancel button 1 83, and re-measurement cannot be directed without 
any restriction. 

[0015] Drawing 4 is the functional block diagram of the three-dimensional-model listing device 
1. The three-dimensional -model listing device 1 consists of modeling system 1A which generates 
the three-dimension geometric model of model size, and processing system IB which actualizes 
a three-dimension geometric model. 

[0016] Modeling system 1 A contains the photography system 30 which changes into digital data 
appearance information of the user 3 who is an original body (data-izing). The photography 
system 30 consists of the three-dimension metering device 34 which data-izes configuration 
information by slit light projection, a total of three two-dimensional photography equipments 
(the main camera 36, auxiliary cameras 37L and 37R) which data-ize color information, and a 
controller 38. In addition, it may replace with slit light projection and other optical technique 
may be used for three-dimension measurement. The color picture data DC2 and DC3 which are 
the photography information on the color picture data DC 1 which are the photography 
information on the configuration data DS which are the measurement information by the three- 
dimension metering device 34, and the main camera 36, and each auxiliary cameras 37L and 37R 
are inputted into a data processor 40. Since the relative relation of the camera coordinate of 
three-dimension measurement and two-dimensional photography is known, it is easy to carry out 
alignment of the three-dimension geometric model based on the configuration data DS and the 
two-dimensional photography image. The data processor 40 is equipped with the image- 
processing circuit which is not illustrated, and performs various kinds of data processing 
including data correction peculiar to this invention. That is, a data processor 40 is a means to 
generate the 2nd configuration data of this invention, and is also a means to compound the 1st 
and 2nd configuration data. The controller 42 of a data processor 40 also bears overall control of 
the three-dimensional-model listing device 1, and gives the suitable directions for the controller 
38 of the photography system 30, and the controller 76 of processing system IB. A display 16 
and the actuation input system 80 are connected to this controller 42. The actuation input system 
80 consists of an above-mentioned control panel 18 and an above-mentioned tariff receipt 
device. 

[001 7] On the other hand, processing system IB is equipped with the processing equipment 72 
which cuts ingredients, such as a resin block, the ingredient feeder 74 which performs supply in 
the processing location of an ingredient, and conveyance to the output port 20 of a workpiece, 
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the controller 76, and the output port sensor 78. The detecting signal of the output port sensor 78 
is inputted into a controller 42. In addition, a controller 42 may be made to take charge of control 
of the photography system 30 and processing system IB, and the circuitry which omitted the 
controller 38 and the controller 76 may be adopted. 

[0018] Drawing 5 is the perspective view showing an example of the device configuration of 
processing system IB. The ingredient feeder 74 has the stock section 210 which contains the 
ingredient of a total of eight sorts of configurations. Storage space is established in the both sides 
of the straight-line-like migration way 212 5 and the elevator 220 is arranged four pieces at a time 
along the migration way 212 in the storage space of each **. Two or more ingredients of the 
same class are accumulated on each elevator 220, and vertical migration control of an elevator 
220 is performed so that the best ingredient may be located in predetermined height. If one kind 
of ingredient suitable for the model which it is going to create is specified, the specified 
ingredient will extrude as a work piece 216, and will be sent out from storage space with a rod 
218 on the migration way 212. And the work piece 216 on the migration way 212 is sent into the 
table 200 of processing equipment 72 with the migration rod 214 with a chuck. 
[0019] In a table 200, a work piece 216 is fixed with two stoppers 202 and clamp fixtures 204. 
And it is cut with the cutters 208, such as an end mill attached in the upper and lower sides, right 
and left, and order at the movable revolving shaft 206. 

[0020] After three-dimension processing is completed, a work piece 216 is pinched by the chuck 
at the tip of the migration rod 214, is carried to the edge by the side of discharge of the migration 
way 212, and is sent into an exhaust port 222. It may not be based on the migration rod 214, but 
a work piece 216 may be moved to an exhaust port 222 from a table 200 in a sliding way format. 
[0021] The device configuration of processing system IB is not restricted to instantiation. For 
example, if an elevator is horizontally arranged [ ingredient / of the same class ] at the end of the 
array direction on each multistage shelf and an ingredient is extruded in an elevator from a shelf, 
the number of elevators can be reduced. You may also carry a work piece to a stowed position -> 
processing location -> discharge location with an arm robot. It is also possible to replace with 
cutting and to create a model by technique, such as the laminating molding method (for the 
Mitsuzo form method to be included), laser processing (thermoforming), and molding 
processings (pressurization etc.). Moreover, about an ingredient configuration, a user 3 may 
enable it to choose a favorite appearance, and may be made to make automatic selection of that 
to which floor to floor time becomes the shortest from two or more sorts of ingredients which 
made the model of a standard face beforehand. 

[0022] In the three-dimensional-model listing device 1 of the above configuration, in order to 
create the natural face model by which the profile of the hair section was reproduced correctly, 
the data correction which transforms automatically the three-dimension geometric model 
obtained by three-dimension measurement is made by the data processor 40. That is, the 
configuration of a data lack part where the effective measurement value of the hair sections is not 
obtained is restored based on two or more two-dimensional images. 
[0023] Drawing 6 is the mimetic diagram of camera arrangement of two-dimensional 
photography. XYZ system of coordinates are set as the space which stands as for a user 3. To a 
longitudinal direction, a Y-axis is taken to a cross direction and the Z-axis is taken for the X-axis 
in the vertical direction. A camera station is defined according to a standard actuation posture, 
and the Z-axis is in agreement with the medial axis of a user's 3 head in drawing 6 . 
[0024] The main camera 36 and the auxiliary cameras 37A and 37B are arranged at a radial at 
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the circumference of the Z-axis, and each look (light-receiving shaft) crosses at one on the Z-axis 
(for example, origin of coordinates). The look of the main camera 36 is in agreement with a Y- 
axis. theta 2 is [ whenever / angle-of-inclination / of the look of auxiliary camera 37L to the main 
camera 36 / whenever / angle-of-inclination / of the look of theta 1 and auxiliary camera 37R ] 
the same. However, it is not necessary to necessarily make thetal and theta2 the same whenever 
[ angle-of-inclination ]. 

[0025] In such camera arrangement, a user 3 is photoed from the front, auxiliary camera 37L 
photos a user 3 from the method of the diagonal left, and, as for the main camera 36, auxiliary 
camera 37R photos a user 3 from the method of the diagonal right. In addition, it is good also as 
a value which may lean each look to a horizontal plane and is different for every camera in 
whenever [ angle-of-inclination ]. 

[0026] Drawing 7 and drawing 8 are drawings for explaining the point of the modeling based on 
a two-dimensional image. A data processor 40 extracts first the hair part (hair image) h to which 
the slash was given by drawing 7 from the two-dimensional images Gl and G2 and G3 which the 
color picture data DC1, DC2, and DC3 express, and extracts the profile of the hair image h 
further. The point of an extract of the hair image h is as follows. ** Divide a two-dimensional 
image into the field of a same color phase by clustering in a specific color space (for example, 
L* a* b* color space). ** the result ~ receiving — labeling ~ carrying out - a same color phase - 
- and extract the continuous field. ** Are in contact with the field of the color (blue) of the 
background sheet 2, and let the field of a setting hue (for example, black and the color near it) be 
the hair image h. 

[0027] Then, the relative relation of the three dimension of the location on the body (user 3) 
corresponding to each profile of the 2-dimensional each images Gl and G2 and the hair image h 
extracted from G3 is specified. That is, the coordinate of the profile of the hair image h when 
setting the hair image h extracted from the two-dimensional images Gl and G2, G3, or them by 
photography conditions, and having arranged to three-dimension space virtually is calculated. 
While making in agreement the core of the image shown with a notation (+) by drawing 7 on the 
occasion of the arrangement to three-dimension space and making a mutual arrangement angular 
relation-ship correspond to the relation between the look at the time of photography, and the 
sense of a field angle, it expands or reduces if needed so that an objective representative fraction 
may be in agreement. The core of an image is a pixel location corresponding to the look at the 
time of photography. With this operation gestalt, since the look at the time of photography is in 
the same flat surface, the 2-dimensional each images Gl and G2 and G3 are made to meet the Z- 
axis, and if only include angles thetal and theta2 lean and arrange the two-dimensional image G2 
and G3 to the two-dimensional image Gl, the sense of a field angle will gather. If the 
photography scale factor is set up identically, there will be no need for expansion/contraction. In 
addition, since the relative-position relation of the hair image h should just be known, it is not 
necessary to make the hair image h into the magnitude which ****sona body in this phase. 
Drawing 7 (B) is the top view showing the physical relationship of the profile of the hair image h 
on one flat surface perpendicular to the Z-axis. When the rim of the hair is modeled, especially 
the location of two points of both ends is important among the locations of X shaft orientations 
of the profile in the attention location of Z shaft orientations. 

[0028] Next, the contour line Lh of an epilogue and the hair is computed for the intersection 
when cutting in respect of being perpendicular to the profile and the Z-axis of a total of three hair 
images h by which virtual arrangement was carried out (level surface) by the B spline curve. And 
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let the field (surface) which connected the contour line Lh in two or more locations of Z shaft 
orientations by smoothing be the geometric model Uh of a hair part. 

[0029] Drawing 9 is the mimetic diagram of composition of a geometric model. Alignment is 
made three-dimension space, the geometric model Uh of the hair part created in the above- 
mentioned way and a user's 3 geometric model Uf obtained by three-dimension measurement are 
arranged to it, the set operation which asks for both sum is performed, and it compounds to one 
geometric model UM. At this time, when it treats as an auxiliary model which restores lack of 
measurement and conflict of a lap arises, the geometric model Uh of a hair part gives priority to 
a geometric model Uf in principle, and adds data correction. 

[0030] Thus, even if some data of the hair were not obtained in three-dimension measurement by 
processing it using the obtained geometric model UM, the face model which reproduced the 
outline of the hair correctly can be created. 

[0031] Hereafter, a flow chart explains actuation of the three-dimensional-model listing device 1. 
Drawing 10 is the Maine flow chart which shows actuation of an outline. After a power source is 
switched on, in the waiting period which waits for actuation by the user, two-dimensional 
photography and the display of a photography result are repeated (#10, #12, #14). Moreover, a 
guidance message is displayed periodically. If a tariff is injected and a start button 181 is pushed, 
while performing two-dimensional photography anew, three-dimension measurement will be 
performed (#16, #18). Predetermined data processing is performed (#20) and the obtained three- 
dimension geometric model is displayed (#22). At this time, appearance is raised with the 
application of the well-known graphic technique of attaching a shadow. And it waits for 
directions actuation. However, the latency time is limited, and if it passes over the time limit, it 
will be considered that it is that to which confirmation operation was performed. 
[0032] If a joy stick 184 is operated, a three-dimension geometric model will be rotated 
according to actuation as mentioned above, and it will display (#24, #38). If Cancel button 183 is 
pushed, it will return to actuation of a waiting period (#40, #10). However, re-measurement will 
be performed, if a user does not need to inject a tariff anew and pushes a start button 1 81 in this 
case. 

[0033] A push on a confirmation button 182 generates the data for processing control with 
reference to a processing condition database based on a three-dimension geometric model (#28). 
(#26) An ingredient is processed (#30). After processing finishes, goods are discharged (#32), 
and it checks that goods have been taken out by the output port sensor 78, and returns to standby 
actuation (#34, #10). 

[0034] Drawing 1 1 is a flow chart which shows the contents of data processing of drawing 10 . 
By this routine, the next processing including the data correction which restores the 
configuration of the hair as mentioned above and compaction of floor to floor time, or 
compression of the depth direction for intentional flattening on a design is performed. 
[0035] While performing data smoothing and removing the abnormality data based on a noise, it 
avoids that excess reappears to fine irregularity (#200). Re-sampling processing is performed 
(#210). This is processing changed into the data which aligned by the lattice point of spacing, 
such as having carried out parallel projection from a certain direction, in order to make the right 
pair of the input data carry out in the processing direction, when the face has turned to slant. For 
example, when the bottom of the lug of people's face becomes shade and cannot measure, after 
wearing a face upward and carrying out three-dimension measurement, data are convertible so 
that the face which turned to the usual transverse plane may be expressed. When there is no 
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measure point in the location where the lattice point was projected, the measurement value of the 
perimeter performs a linearity complement. At this time, it becomes the vertical upper part at the 
time of the projected direction processing it, and each lattice point has data of height. Moreover, 
even when input data is based on a perspective projection, input data can be changed into parallel 
projection data by this processing. 

[0036] A fine deficit part without data is complemented (#220). As the complement technique, 
various technique, such as a linearity complement and weighting ****, is applicable. For 
example, all the parts into which data are missing are replaced with a fixed value (simple 
complement). As the fixed value, the average of the set point, the minimum height, and the 
periphery location of a face can be considered. When the deficit section is completely 
surrounded in the effective-data part, a linearity complement is carried out from surrounding 
data. Thereby, the deficit part in the face (for example, black eyebrows) is restored. 
[0037] The geometric model Uh of a hair part is created in the way mentioned above, and it 
compounds with the geometric model Uf based on the observation data of a three dimension. 
That is, the partial correction which adds the hair is made to a geometric model Uf (#230). 
Stripes-like boom hoisting is added to a hair part in this phase, texture can be raised or emphasis 
which heaps up particular parts, such as an eye, an iris-of-the-eye part, eyebrows, a lip, and a 
cheek, a little can be performed. 

[0038] After obtaining the geometric model UM faithful to an object configuration by each 
above processing, height compression processing is performed and the dimension of a three- 
dimension geometric model is contracted in the depth direction (#240). If the difference of 
elevation of the depth direction becomes small, floor to floor time will become short. Moreover, 
for the application of a pendant or a medal, a superficial model is suitable. To compression, both 
of the technique, uniform compression and un-uniform compression, can be applied, and it can 
also use properly for every part to it. 

[0039] A part for the background of the three-dimension geometric models is detected (#250). 
This is pretreatment for correcting a part for a background. If a user's tooth back is considered as 
the blue back with the background sheet 3, a part for a background is certainly [ easily and ] 
detectable with color distinction of a two-dimensional image. 

[0040] Background conversion transposed to other data about a part for a background is 
performed (#260). For example, since depth is extremely deep, a part for a background is 
changed into data with shallow depth in order to shorten floor to floor time. The solid side data 
which express patterns and geometric patterns, such as flowering trees and shrubs, also by flat- 
surface data are sufficient as the data to replace. 

[0041] Size adjustment in which a full-scale three-dimension geometric model is fitted to goods 
size is performed (#270). Moreover, resolution conversion in which the amount of data is fitted 
to the precision of processing equipment 72 is performed (#280). Although this processing 
projects the mesh of predetermined grid width of face and it re-samples in the lattice point, the 
direction to project is being fixed in the direction of a vertical at the time of processing. As the 
point of resolution conversion (the number conversion of data), first, the pitch between points 
and ** KUTORU variation define the configuration point group of the geometric model for 
processing, and the pitch range between points corresponding to ** KUTORU variation is read 
from the property data table memorized beforehand, and is set up. That is, data are thinned out, a 
pitch is enlarged, or data are interpolated and a pitch is made small. What is necessary is only 
just to cull out, when the resolution of measurement is large enough. If the resolution conversion 
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function is prepared, since the resolution of the three-dimension metering device 34 will not be 
limited, the use gestalt of exchanging a measurement means according to an application will be 
permitted. 

[0042] Alignment to which the parallel displacement of the zero of a coordinate is carried out so 
that the criteria location of a three-dimension geometric model may suit the last in the criteria 
location of processing is performed (#290). In addition, when using the ingredient with which 
predetermined irregularity was made above beforehand on the occasion of processing, in the 
processing data generation processing (#28 of drawing 10 ) in response to confirmation 
operation, the amount of cutting is computed by comparing the three-dimension geometric model 
obtained by the above processing with the irregularity made. 

[0043] Drawing 12 is the flow chart of the partial correction subroutine of drawing 1 1 . As 
drawing 7 explained, the two-dimensional images Gl and G2 and G3 which are the photography 
information on three directions first are incorporated (#301), and it is L* a* b*. Field division in 
a color space is performed (#302). The field of a setting hue is distinguished from the hair image 
h (#303), and the profile is extracted (#304). It asks for the high line Lh, such as having 
corresponded to the profile of the hair image h, (#305), a contour line Lh is connected, and the 
geometric model Uh of the hair is generated (#306). And the geometric model Uh of the hair 
based on a two-dimensional image and the geometric model Uf based on three-dimension 
measurement are compounded (#307). 

[0044] the above operation gestalt — setting ~ the scalp from three-dimension measurement data 
- the scalp the configuration of a field was presumed to be and the configuration created from 
the two-dimensional image was presumed to be in the following ways with reference to the result 
~ it is desirable to make it not become inside a field. 

[0045] drawing 13 - the scalp - the mimetic diagram of presumption of a field configuration, 
and drawing 14 - the scalp - it is the flow chart which shows an example of the creation point 
of a field geometric model. The profile of a user's 3 head is obtained from the geometric model 
Uf which consists of a face field Ufl and a hair field U£2 (#3051). the middle point (black dot of 
drawing 13 ) between the points with which two or more suitable points on a profile (white 
round head of drawing 13 ) were chosen and which were adjoined of the selected point or them - 
a control point — carrying out ~ a spline curve — the scalp - a field configuration is 
approximated (#3052, #3053). The approximation curve which passes along the inside of the 
profile of the hair is obtained by making the point on a profile into a control point about the face 
field Ufl, and making the middle point into a control point about the hair field Uf2. two or more 
approximation curves in the same way — asking — between them — surface ~ interpolating — the 
scalp - the field geometric model Us is obtained (#3054). 

[0046] Although the three-dimensional-model listing device 1 supposing the use as an automatic 
vending machine was illustrated with the above-mentioned operation gestalt, it does not ask 
whether data processing concerning this invention is whether model creation is onerous and 
onerous. Not only contraction size but actual size or expansion size is sufficient as the size of a 
model, the geometric model UM obtained by composition with the geometric model Uh based on 
two or more two-dimensional images and the geometric model Uf based on three-dimension 
measurement data can be used for an application at versatility other than model creation, such as 
a display and animation creation. 
[0047] 

[Effect of the Invention] According to invention of claim 1 or claim 2, three-dimension 
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measurement can realize modeling of the configuration of a body with a difficult part like the 
hair configuration of the body. 



[Translation done.] 
TECHNICAL FIELD 



[Field of the Invention] This invention is used for creation of the model of a body head, 
concerning the modeling system which generates the geometric model of the body which exists. 



[Translation done.] 
PRIOR ART 



[Description of the Prior Art] The non-contact type three-dimension metering device (range 
finder) of a portable mold is commercialized, and it is used for the visual recognition of the data 
input to CG system or a CAD system, a somatometry, and a robot etc. As the non-contact 
measurement approach, although slit light projection (optical cutting method) is common, 
otherwise, pattern light projection, the stereo ** method, the interference fringe method, etc. are 
learned. 

[0003] On the other hand, a kind of automatic vending machine which creates a user's 
photograph-of-his-face seal on that spot is collecting popularity. A user throws in the coin for a 
tariff, and he makes a favorite pose by Saki of a camera, looking at a monitor image. And if 
predetermined actuation is performed, the sheet with which a fixed number of seals were located 
in a line will be created, and it will be discharged by output port. 



[Translation done.] 

EFFECT OF THE INVENTION 



[Effect of the Invention] According to invention of claim 1 or claim 2, three-dimension 
measurement can realize modeling of the configuration of a body with a difficult part like the 
hair configuration of the body. 
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[Translation done.] 



TECHNICAL PROBLEM 



[Problem(s) to be Solved by the Invention] According to the above-mentioned three-dimension 
metering device, the configuration of the various bodies which contain the body by handiness 
comparable as taking a photograph can be data-ized. Since it is a non-contact type, even if it is 
the case where the body is measured, a measurement candidate does not sense troublesomeness. 
[0005] However, in especially the optical three-dimension measurement that projects reference 
beams, such as slit light, the configuration of the hair part of the body may be correctly 
immeasurable. That is, with black hair, since the reflection factor of a reference beam is low, the 
light income of a range finder becomes inadequate and a measurement value tends to be missing. 
Moreover, the effect of a hair style is also large. For this reason, on the occasion of creation of 
the geometric model of a body head, there was a problem of a hair part not having been 
reproduced or becoming imperfect. 

[0006] This invention aims at three-dimension measurement realizing modeling of the 
configuration of a body with a difficult part. 



[Translation done.] 
MEANS 



[Means for Solving the Problem] In this invention, the part of an objective specific color is 
modeled in simple using two or more two-dimensional photography information that whenever [ 
to a body / angle-of-coverage ] differ. For example, from each of two or more two-dimensional 
images which photoed the body from a mutually different location and were obtained, the field 
which fills the setups of color information is extracted and the geometric model of the part which 
fills the setups in a body is generated by calculating the coordinate in the virtual space of the 
location on the body corresponding to each profile of two or more extracted fields. Two or more 
two-dimensional images which photoed the body in more detail from the location where they 
differ mutually as a look crosses at one point in, and were obtained Image size is arranged so that 
an objective representative fraction may be in agreement, it arranges to a virtual space so that 
each core may be in agreement and a mutual arrangement angular relation-ship may correspond 
to the relation of the sense of a look and a field angle, and the relative-position relation of the 
profile of the field which fills the setups of the color information extracted from the 2- 
dimensional each image is calculated. The core of an image is a pixel location corresponding to 
the look at the time of photography (light-receiving shaft). 

[0008] A geometric model with high fidelity is obtained by using together modeling based on the 
three-dimension measurement information in which modeling based on two-dimensional 
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photography information and modeling highly precise than it are possible. 
[0009] The modeling system of invention of claim 1 has a three-dimension measurement means 
to measure an objective three-dimension configuration and to output the 1st configuration data, a 
means to photo said body from a different location and to obtain two or more two-dimensional 
images, a means to generate the 2nd configuration data based on said two or more two- 
dimensional images, and a means to compound said 1st and 2nd configuration data. The 
hardware containing the processor for a general purpose or image processings and suitable 
software can constitute a means to generate configuration data, and a means to compound. 
[0010] In the modeling system of invention of claim 2, said three-dimension measurement means 
projects a reference beam on a body, receives the reflected light, and measures a configuration 
based on the light-receiving output. 
[0011] 

[Embodiment of the Invention] Drawing 1 is the external view of the three-dimensional-model 
listing device 1 concerning this invention. The three-dimensional-model listing device 1 
measures a body configuration, has the function to process a material on that spot based on the 
measurement data, and is used as an automatic vending machine of the accessories article which 
modeled a user's face. The goods created are the stereos with which the model of the face (the 
hair is included) projected from the plate surface of a predetermined configuration (for example, 
square). It is also possible to add a specific boom-hoisting pattern to a plate surface (a part for a 
background). If the suitable metallic ornaments for such goods are attached, it will become 
accessories, such as a pendant, a broach, and a key holder. Metallic ornaments may be 
beforehand attached in a material. 

[0012] The floodlighting aperture 12 and the light-receiving apertures 14, 15 A, and 15B are 
formed in the front face of the almost life-size Johan section of a case 10 with the display 16 for 
a user to check a pause. Optical three-dimension measurement is performed using the 
floodlighting aperture 12 and the light-receiving aperture 14. The light-receiving aperture 14 is 
used also for the two-dimensional color photography of the direction of a transverse plane. The 
light-receiving apertures 15A and 15B are used for the two-dimensional color photography of the 
direction of slant peculiar to this invention. The bottom half section of a case 10 is jutted out 
over the front side rather than the Johan section, and the top face serves as a control panel 18. 
The output port 20 of goods is established in the front face of the bottom half section. 
[0013] Drawing 2 is the mimetic diagram of the busy condition of the three-dimensional-model 
listing device 1 . The blue background sheet 2 is arranged ahead of the three-dimensional-model 
listing device 1. A user 3 stands toward the three-dimensional-model listing device 1, using the 
background sheet 2 as the back, and throws in the coin for a tariff. If a user 3 performs start 
actuation after that, the three-dimensional-model listing device 1 will display the three- 
dimension geometric model (for example, surface model) which shows a measurement result 
while measuring the configuration of the body which exists within the limits of [ fixed ] a 
transverse plane. And if a user 3 performs confirmation operation, the three-dimensional-model 
listing device 1 will start three-dimension processing according to a measurement result. Goods 
are completed by the time amount for about several minutes. A user 3 takes out goods from 
output port 20. 

[0014] Drawing 3 is the top view of a control panel 18. The input port 185 of a start button 181, 
a confirmation button 182, Cancel button 183, a joy stick 184, and a coin is established in the 
control panel 18. A start button 181 is a start actuation means, and a confirmation button 182 is a 
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confirmation operation means. A joy stick 184 is used for modification directions of the 
composition of a model In response to the Pan actuation leaned to right and left, the tilt 
actuation leaned up and down, and roll actuation of rotating a knob, rotation processing of a 
three-dimension geometric model is performed, and a processing result is displayed on serial. 
Moreover, Cancel button 183 is an actuation means for directing re-measurement, when the 
three-dimension geometric model as which the user 3 was displayed is not pleasing. However, 
the count of effective is set to Cancel button 1 83, and re-measurement cannot be directed without 
any restriction. 

[0015] Drawing 4 is the functional block diagram of the three-dimensional-model listing device 
1. The three-dimensional -model listing device 1 consists of modeling system 1A which generates 
the three-dimension geometric model of model size, and processing system IB which actualizes 
a three-dimension geometric model. 

[0016] Modeling system 1 A contains the photography system 30 which changes into digital data 
appearance information of the user 3 who is an original body (data-izing). The photography 
system 30 consists of the three-dimension metering device 34 which data-izes configuration 
information by slit light projection, a total of three two-dimensional photography equipments 
(the main camera 36, auxiliary cameras 37L and 37R) which data-ize color information, and a 
controller 38. In addition, it may replace with slit light projection and other optical technique 
may be used for three-dimension measurement. The color picture data DC2 and DC3 which are 
the photography information on the color picture data DC 1 which are the photography 
information on the configuration data DS which are the measurement information by the three- 
dimension metering device 34, and the main camera 36, and each auxiliary cameras 37L and 37R 
are inputted into a data processor 40. Since the relative relation of the camera coordinate of 
three-dimension measurement and two-dimensional photography is known, it is easy to carry out 
alignment of the three-dimension geometric model based on the configuration data DS and the 
two-dimensional photography image. The data processor 40 is equipped with the image- 
processing circuit which is not illustrated, and performs various kinds of data processing 
including data correction peculiar to this invention. That is, a data processor 40 is a means to 
generate the 2nd configuration data of this invention, and is also a means to compound the 1st 
and 2nd configuration data. The controller 42 of a data processor 40 also bears overall control of 
the three-dimensional -model listing device 1, and gives the suitable directions for the controller 
38 of the photography system 30, and the controller 76 of processing system IB. A display 16 
and the actuation input system 80 are connected to this controller 42. The actuation input system 
80 consists of an above-mentioned control panel 1 8 and an above-mentioned tariff receipt 
device. 

[0017] On the other hand, processing system IB is equipped with the processing equipment 72 
which cuts ingredients, such as a resin block, the ingredient feeder 74 which performs supply in 
the processing location of an ingredient, and conveyance to the output port 20 of a workpiece, 
the controller 76, and the output port sensor 78. The detecting signal of the output port sensor 78 
is inputted into a controller 42. In addition, a controller 42 may be made to take charge of control 
of the photography system 30 and processing system IB, and the circuitry which omitted the 
controller 38 and the controller 76 may be adopted. 

[0018] Drawing 5 is the perspective view showing an example of the device configuration of 
processing system IB. The ingredient feeder 74 has the stock section 210 which contains the 
ingredient of a total of eight sorts of configurations. Storage space is established in the both sides 
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of the straight-line-like migration way 212, and the elevator 220 is arranged four pieces at a time 
along the migration way 212 in the storage space of each **. Two or more ingredients of the 
same class are accumulated on each elevator 220, and vertical migration control of an elevator 
220 is performed so that the best ingredient may be located in predetermined height. If one kind 
of ingredient suitable for the model which it is going to create is specified, the specified 
ingredient will extrude as a work piece 216, and will be sent out from storage space with a rod 
218 on the migration way 212. And the work piece 216 on the migration way 212 is sent into the 
table 200 of processing equipment 72 with the migration rod 214 with a chuck. 
[0019] In a table 200, a work piece 216 is fixed with two stoppers 202 and clamp fixtures 204. 
And it is cut with the cutters 208, such as an end mill attached in the upper and lower sides, right 
and left, and order at the movable revolving shaft 206. 

[0020] After three-dimension processing is completed, a work piece 216 is pinched by the chuck 
at the tip of the migration rod 214, is carried to the edge by the side of discharge of the migration 
way 212, and is sent into an exhaust port 222. It may not be based on the migration rod 214, but 
a work piece 216 may be moved to an exhaust port 222 from a table 200 in a sliding way format. 
[0021] The device configuration of processing system IB is not restricted to instantiation. For 
example, if an elevator is horizontally arranged [ ingredient / of the same class ] at the end of the 
array direction on each multistage shelf and an ingredient is extruded in an elevator from a shelf, 
the number of elevators can be reduced. You may also carry a work piece to a stowed position -> 
processing location -> discharge location with an arm robot. It is also possible to replace with 
cutting and to create a model by technique, such as the laminating molding method (for the 
Mitsuzo form method to be included), laser processing (thermoforming), and molding 
processings (pressurization etc.). Moreover, about an ingredient configuration, a user 3 may 
enable it to choose a favorite appearance, and may be made to make automatic selection of that 
to which floor to floor time becomes the shortest from two or more sorts of ingredients which 
made the model of a standard face beforehand. 

[0022] In the three-dimensional-model listing device 1 of the above configuration, in order to 
create the natural face model by which the profile of the hair section was reproduced correctly, 
the data correction which transforms automatically the three-dimension geometric model 
obtained by three-dimension measurement is made by the data processor 40. That is, the 
configuration of a data lack part where the effective measurement value of the hair sections is not 
obtained is restored based on two or more two-dimensional images. 
[0023] Drawing 6 is the mimetic diagram of camera arrangement of two-dimensional 
photography. XYZ system of coordinates are set as the space which stands as for a user 3. To a 
longitudinal direction, a Y-axis is taken to a cross direction and the Z-axis is taken for the X-axis 
in the vertical direction. A camera station is defined according to a standard actuation posture, 
and the Z-axis is in agreement with the medial axis of a user's 3 head in drawing 6 . 
[0024] The main camera 36 and the auxiliary cameras 37A and 37B are arranged at a radial at 
the circumference of the Z-axis, and each look (light-receiving shaft) crosses at one on the Z-axis 
(for example, origin of coordinates). The look of the main camera 36 is in agreement with a Y- 
axis. theta 2 is [ whenever / angle-of-inclination / of the look of auxiliary camera 37L to the main 
camera 36 / whenever / angle-of-inclination / of the look of theta 1 and auxiliary camera 37R ] 
the same. However, it is not necessary to necessarily make theta 1 and theta2 the same whenever 
[ angle-of-inclination ]. 

[0025] In such camera arrangement, a user 3 is photoed from the front, auxiliary camera 37L 
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photos a user 3 from the method of the diagonal left, and, as for the main camera 36, auxiliary 
camera 37R photos a user 3 from the method of the diagonal right. In addition, it is good also as 
a value which may lean each look to a horizontal plane and is different for every camera in 
whenever [ angle-of-inclination ]. 

[0026] Drawing 7 and drawing 8 are drawings for explaining the point of the modeling based on 
a two-dimensional image. A data processor 40 extracts first the hair part (hair image) h to which 
the slash was given by drawing 7 from the two-dimensional images Gl and G2 and G3 which the 
color picture data DC1, DC2, and DC3 express, and extracts the profile of the hair image h 
further. The point of an extract of the hair image h is as follows. ** Divide a two-dimensional 
image into the field of a same color phase by clustering in a specific color space (for example, 
L* a* b* color space). ** the result — receiving — labeling — carrying out — a same color phase - 
- and extract the continuous field. ** Are in contact with the field of the color (blue) of the 
background sheet 2, and let the field of a setting hue (for example, black and the color near it) be 
the hair image h. 

[0027] Then, the relative relation of the three dimension of the location on the body (user 3) 
corresponding to each profile of the 2-dimensional each images Gl and G2 and the hair image h 
extracted from G3 is specified. That is, the coordinate of the profile of the hair image h when 
setting the hair image h extracted from the two-dimensional images Gl and G2, G3, or them by 
photography conditions, and having arranged to three-dimension space virtually is calculated. 
While making in agreement the core of the image shown with a notation (+) by drawing 7 on the 
occasion of the arrangement to three-dimension space and making a mutual arrangement angular 
relation-ship correspond to the relation between the look at the time of photography, and the 
sense of a field angle, it expands or reduces if needed so that an objective representative fraction 
may be in agreement. The core of an image is a pixel location corresponding to the look at the 
time of photography. With this operation gestalt, since the look at the time of photography is in 
the same flat surface, the 2-dimensional each images Gl and G2 and G3 are made to meet the Z- 
axis, and if only include angles thetal and theta2 lean and arrange the two-dimensional image G2 
and G3 to the two-dimensional image Gl , the sense of a field angle will gather. If the 
photography scale factor is set up identically, there will be no need for expansion/contraction. In 
addition, since the relative-position relation of the hair image h should just be known, it is not 
necessary to make the hair image h into the magnitude which ****s on a body in this phase. 
Drawing 7 (B) is the top view showing the physical relationship of the profile of the hair image h 
on one flat surface perpendicular to the Z-axis. When the rim of the hair is modeled, especially 
the location of two points of both ends is important among the locations of X shaft orientations 
of the profile in the attention location of Z shaft orientations. 

[0028] Next, the contour line Lh of an epilogue and the hair is computed for the intersection 
when cutting in respect of being perpendicular to the profile and the Z-axis of a total of three hair 
images h by which virtual arrangement was carried out (level surface) by the B spline curve. And 
let the field (surface) which connected the contour line Lh in two or more locations of Z shaft 
orientations by smoothing be the geometric model Uh of a hair part. 

[0029] Drawing 9 is the mimetic diagram of composition of a geometric model. Alignment is 
made three-dimension space, the geometric model Uh of the hair part created in the above- 
mentioned way and a user's 3 geometric model Uf obtained by three-dimension measurement are 
arranged to it, the set operation which asks for both sum is performed, and it compounds to one 
geometric model UM. At this time, when it treats as an auxiliary model which restores lack of 
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measurement and conflict of a lap arises, the geometric model Uh of a hair part gives priority to 
a geometric model Uf in principle, and adds data correction. 

[0030] Thus, even if some data of the hair were not obtained in three-dimension measurement by 
processing it using the obtained geometric model UM, the face model which reproduced the 
outline of the hair correctly can be created. 

[0031] Hereafter, a flow chart explains actuation of the three-dimensional-model listing device 1. 
Drawing 10 is the Maine flow chart which shows actuation of an outline. After a power source is 
switched on, in the waiting period which waits for actuation by the user, two-dimensional 
photography and the display of a photography result are repeated (#10, #12, #14). Moreover, a 
guidance message is displayed periodically. If a tariff is injected and a start button 181 is pushed, 
while performing two-dimensional photography anew, three-dimension measurement will be 
performed (#16, #18). Predetermined data processing is performed (#20) and the obtained three- 
dimension geometric model is displayed (#22). At this time, appearance is raised with the 
application of the well-known graphic technique of attaching a shadow. And it waits for 
directions actuation. However, the latency time is limited, and if it passes over the time limit, it 
will be considered that it is that to which confirmation operation was performed. 
[0032] If a joy stick 184 is operated, a three-dimension geometric model will be rotated 
according to actuation as mentioned above, and it will display (#24, #38). If Cancel button 183 is 
pushed, it will return to actuation of a waiting period (#40, #10). However, re-measurement will 
be performed, if a user does not need to inject a tariff anew and pushes a start button 1 81 in this 
case. 

[0033] A push on a confirmation button 1 82 generates the data for processing control with 
reference to a processing condition database based on a three-dimension geometric model (#28). 
(#26) An ingredient is processed (#30). After processing finishes, goods are discharged (#32), 
and it checks that goods have been taken out by the output port sensor 78, and returns to standby 
actuation (#34, #10). 

[0034] Drawing 1 1 is a flow chart which shows the contents of data processing of drawing 10 . 
By this routine, the next processing including the data correction which restores the 
configuration of the hair as mentioned above and compaction of floor to floor time, or 
compression of the depth direction for intentional flattening on a design is performed. 
[0035] While performing data smoothing and removing the abnormality data based on a noise, it 
avoids that excess reappears to fine irregularity (#200). Re-sampling processing is performed 
(#210). This is processing changed into the data which aligned by the lattice point of spacing, 
such as having carried out parallel projection from a certain direction, in order to make the right 
pair of the input data carry out in the processing direction, when the face has turned to slant. For 
example, when the bottom of the lug of peopled face becomes shade and cannot measure, after 
wearing a face upward and carrying out three-dimension measurement, data are convertible so 
that the face which turned to the usual transverse plane may be expressed. When there is no 
measure point in the location where the lattice point was projected, the measurement value of the 
perimeter performs a linearity complement. At this time, it becomes the vertical upper part at the 
time of the projected direction processing it, and each lattice point has data of height. Moreover, 
even when input data is based on a perspective projection, input data can be changed into parallel 
projection data by this processing. 

[0036] A fine deficit part without data is complemented (#220). As the complement technique, 
various technique, such as a linearity complement and weighting ****, is applicable. For 
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example, all the parts into which data are missing are replaced with a fixed value (simple 
complement). As the fixed value, the average of the set point, the minimum height, and the 
periphery location of a face can be considered. When the deficit section is completely 
surrounded in the effective-data part, a linearity complement is carried out from surrounding 
data. Thereby, the deficit part in the face (for example, black eyebrows) is restored. 
[0037] The geometric model Uh of a hair part is created in the way mentioned above, and it 
compounds with the geometric model Uf based on the observation data of a three dimension. 
That is, the partial correction which adds the hair is made to a geometric model Uf (#230). 
Stripes-like boom hoisting is added to a hair part in this phase, texture can be raised or emphasis 
which heaps up particular parts, such as an eye, an iris-of-the-eye part, eyebrows, a lip, and a 
cheek, a little can be performed. 

[0038] After obtaining the geometric model UM faithful to an object configuration by each 
above processing, height compression processing is performed and the dimension of a three- 
dimension geometric model is contracted in the depth direction (#240). If the difference of 
elevation of the depth direction becomes small, floor to floor time will become short. Moreover, 
for the application of a pendant or a medal, a superficial model is suitable. To compression, both 
of the technique, uniform compression and un-uniform compression, can be applied, and it can 
also use properly for every part to it. 

[0039] A part for the background of the three-dimension geometric models is detected (#250). 
This is pretreatment for correcting a part for a background. If a user's tooth back is considered as 
the blue back with the background sheet 3, a part for a background is certainly [ easily and ] 
detectable with color distinction of a two-dimensional image. 

[0040] Background conversion transposed to other data about a part for a background is 
performed (#260). For example, since depth is extremely deep, a part for a background is 
changed into data with shallow depth in order to shorten floor to floor time. The solid side data 
which express patterns and geometric patterns, such as flowering trees and shrubs, also by flat- 
surface data are sufficient as the data to replace. 

[0041] Size adjustment in which a full-scale three-dimension geometric model is fitted to goods 
size is performed (#270). Moreover, resolution conversion in which the amount of data is fitted 
to the precision of processing equipment 72 is performed (#280). Although this processing 
projects the mesh of predetermined grid width of face and it re-samples in the lattice point, the 
direction to project is being fixed in the direction of a vertical at the time of processing. As the 
point of resolution conversion (the number conversion of data), first, the pitch between points 
and ** KUTORU variation define the configuration point group of the geometric model for 
processing, and the pitch range between points corresponding to ** KUTORU variation is read 
from the property data table memorized beforehand, and is set up. That is, data are thinned out, a 
pitch is enlarged, or data are interpolated and a pitch is made small. What is necessary is only 
just to cull out, when the resolution of measurement is large enough. If the resolution conversion 
function is prepared, since the resolution of the three-dimension metering device 34 will not be 
limited, the use gestalt of exchanging a measurement means according to an application will be 
permitted. 

[0042] Alignment to which the parallel displacement of the zero of a coordinate is carried out so 
that the criteria location of a three-dimension geometric model may suit the last in the criteria 
location of processing is performed (#290). In addition, when using the ingredient with which 
predetermined irregularity was made above beforehand on the occasion of processing, in the 
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processing data generation processing (#28 of drawing 10 ) in response to confirmation 
operation, the amount of cutting is computed by comparing the three-dimension geometric model 
obtained by the above processing with the irregularity made. 

[0043] Drawing 12 is Hie flow chart of the partial correction subroutine of drawing 1 1 . As 
drawing 7 explained, the two-dimensional images Gl and G2 and G3 which are the photography 
information on three directions first are incorporated (#301), and it is L* a* b*. Field division in 
a color space is performed (#302). The field of a setting hue is distinguished from the hair image 
h (#303), and the profile is extracted (#304). It asks for the high line Lh, such as having 
corresponded to the profile of the hair image h, (#305), a contour line Lh is connected, and the 
geometric model Uh of the hair is generated (#306). And the geometric model Uh of the hair 
based on a two-dimensional image and the geometric model Uf based on three-dimension 
measurement are compounded (#307). 

[0044] the above operation gestalt — setting - the scalp from three-dimension measurement data 

the scalp the configuration of a field was presumed to be and the configuration created from 
the two-dimensional image was presumed to be in the following ways with reference to the result 
— it is desirable to make it not become inside a field. 

[0045] drawing 13 — the scalp — the mimetic diagram of presumption of a field configuration, 
and drawing 14 — the scalp — it is the flow chart which shows an example of the creation point 
of a field geometric model. The profile of a user's 3 head is obtained from the geometric model 
Uf which consists of a face field Ufl and a hair field Uf2 (#305 1). the middle point (black dot of 
drawing 13 ) between the points with which two or more suitable points on a profile (white 
round head of drawing 1 3 ) were chosen and which were adjoined of the selected point or them -- 
a control point — carrying out — a spline curve — the scalp — a field configuration is 
approximated (#3052, #3053). The approximation curve which passes along the inside of the 
profile of the hair is obtained by making the point on a profile into a control point about the face 
field Ufl, and making the middle point into a control point about the hair field Uf2. two or more 
approximation curves in the same way - asking — between them — surface - interpolating — the 
scalp - the field geometric model Us is obtained (#3054). 

[0046] Although the three-dimensional-model listing device 1 supposing the use as an automatic 
vending machine was illustrated with the above-mentioned operation gestalt, it does not ask 
whether data processing concerning this invention is whether model creation is onerous and 
onerous. Not only contraction size but actual size or expansion size is sufficient as the size of a 
model, the geometric model UM obtained by composition with the geometric model Uh based on 
two or more two-dimensional images and the geometric model Uf based on three-dimension 
measurement data can be used for an application at versatility other than model creation, such as 
a display and animation creation. 



[Translation done.] 
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DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is the external view of the three-dimensional-model listing device concerning this 
invention. 

[Drawing 21 It is the mimetic diagram of the busy condition of a three-dimensional-model listing 
device. 

[Drawing 3] It is the top view of a control panel. 

[Drawing 4] It is the functional block diagram of a three-dimensional-model listing device. 
[Drawing 5] It is the perspective view showing an example of the device configuration of a 
processing system. 

[Drawing 61 It is the mimetic diagram of camera arrangement of two-dimensional photography. 
[Drawing 71 It is drawing for explaining the point of the modeling based on a two-dimensional 
image. 

[Drawing 81 It is drawing for explaining the point of the modeling based on a two-dimensional 
image. 

[Drawing 91 It is the mimetic diagram of composition of a geometric model. 

[Drawing 101 It is the Maine flow chart which shows actuation of an outline. 

[Drawing 111 It ls the flow chart which shows the contents of data processing of drawing 10 . 

[Drawing 121 It is the flow chart of the partial correction subroutine of drawing 1 1 . 

[Drawing 131 the scalp ~ it is the mimetic diagram of presumption of a field configuration. 

[Drawing 141 the scalp — it is the flow chart which shows an example of the creation point of a 

field geometric model. 

[Description of Notations] 

1 A Modeling system 

3 User (Body) 

30 Photography System 

34 Three-Dimension Metering Device (Three-Dimension Measuring Device) 

40 Data Processor 

Gl-3 Two-dimensional image 

Uf Geometric model (1st configuration data) 

Uh Geometric model (2nd configuration data) 



[Translation done.] 
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Abstract of JP1 1328444 
PROBLEM TO BE SOLVED: To model the 
shape of a body having a part which is hardly 
measured in three dimensions by synthesizing 
three-dimensional shape data with plural two- 
dimensional shape data of the body. 
SOLUTION: A generated shape model Uh for 
a head hair part and a shape model Uf for a 
customer obtained through three-dimensional 
measurement are positioned and arranged in a 
three-dimensional space and set operation for 
finding the sum of the both is performed to 
synthesizing one shape model UM. At this 
time, the shape model Uh for the head hair 
part is handled as an auxiliary model for 
restoring deficiencies of the measurement and 
when superposition is contradictory, data 
corrections are made while priority is given to 
the shape model Uf in principle. The shape 
model UM which is thus obtained is used to 
perform processing and then even if data of 
part of the head hair is not obtained by the 
three-dimensional measurement, a face model 
having the outline of the head hair correctly 
reproduced can be generated. 
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